A language model predicts the next word based on context. Perplexity (PPL) measures its confusion. A low PPL model is confident (narrow choices), while a high PPL model is uncertain (many choices).